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Abstract 

For a Calabi-Yau 3-fold X, we explicitly compute the Donaldson-Thomas type 
invariant counting pairs (F, V), where F is a zero-dimensional coherent sheaf on X 
and V C F is a two dimensional linear subspace, which satisfy a certain stability 
condition. This is a rank two version of the DT-invariant of rank one, studied by 
Li, Behrend-Fantechi and Levine-Pandharipande. We use the wall-crossing formula 
of DT-invariants established by Joyce-Song, Kontsevich-Soibelman. 

1 Introduction 

The purpose of this article is to write down a closed formula of the generating series of 
certain rank two Donaldson-Thomas (DT) type invariants on Calabi-Yau 3-folds. The 
DT-invariant is a counting invariant of stable coherent sheaves on X, and it is introduced 
in [2T] in order to give a holomorphic analogue of the Casson invariant on real 3-manifolds. 
It is now conjectured by Maulik-Nekrasov-Okounkov-Pandharipande (MNOP) [19] that 
Gromov-Witten invariants and rank one DT-invariants are related in terms of generating 
functions. So far, rank one DT-invariants have been studied in several papers, e.g. [TT] . 

On the other hand, it seems that higher rank DT-invariants have not been explicitly 
calculated yet in any example. Although the rank one case is important in connection with 
MNOP conjecture, there is also some motivation of studying higher rank DT-invariants. 
For instance, the rank of a coherent sheaf is not preserved under Fourier-Mukai transfor- 
mations, e.g. the Pfaffian-Grassmannian derived equivalence established in [1]. Hence in 
order to compare DT-invariants under Fourier-Mukai transformations, it seems that we 
also have to work with higher rank DT-invariants. 

Recently the wall-crossing formula of DT-invariants has been developed by Joyce- 
Song [13] and Kontsevich-Soibelman [Hj . As pointed out in [T¥l Paragraph 6.5], cer- 
tain higher rank DT-type invariants are in principle calculated by the wall-crossing for- 
mula, if we are given data for the DT-invariants of rank one. In this article, we work 
out the wall-crossing formula established by Joyce-Song [13], and write down the ex- 
plicit formula of DT-type invariants counting rank two D0-D6 bound state, discussed 
in [T^t Paragraph 6.5]. We also give an evidence of the integrality conjecture proposed by 
Kontsevich-Soibelman [HJ Conjecture 6]. 
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1.1 Rank one Donaldson-Thomas invariant 

Let X be a smooth projective Calabi-Yau 3-fold over C, i.e. Kx = A 3 T X is trivial and 
H l (O x ) = 0. For neZ, let Hilb n (X) is the Hilbert scheme of n-points in X, 

Hilb n (X) = {Z C X : dimZ = 0, length O z = n}, 

, „ \ F is a zero-dimensional coherent sheaf on X with 
length n, and v G F generates F as an Ox-module. 

The moduli space Hilb n (X) is projective and has a symmetric obstruction theory [2"T] . 
By integrating the associated zero- dimensional virtual cycle, we can define the rank one 
Donaldson-Thomas (DT) invariant, 



DT(l,n) = / 1 G Z. 

Another way of defining DT-invariant is to use Behrend's constructible function [I], 

v: Hilb n (X) -> Z. 
In [1], K. Behrend shows that DT(l,n) is also written as 

DT(l,n)= / i/ <*X == y>x(" -1 (A0), 
Jffiib"(x) fcez 

where x{*) is the topological Euler characteristic. Let DT(1) be the generating series, 

DT(l) = ^DT(l,n)g". 

The series DT(1) is computed by Li [17], Behrend- Fantechi [3] and Pandharipande- 
Levine |16|. 



Theorem 1.1. |17j . [3], | |16| We have the following formula, 

DT(1) = M(-g) x(x) . 
i/ere M(g) is the MacMahon function, 



^) = Il7rr 



k>i y H > 



1.2 Rank two Donaldson-Thomas invariant 

In this article, we consider a rank two analogue of the invariant DT(l,n). Let F be a 
zero-dimensional coherent sheaf on X with length n, and V C -F is a two dimensional 
C-vector subspace. We call the pair (F, V) semistable (resp. stable) if it satisfies the 
following stability condition. 
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• The subspace V C F generates F as an Ox-module. 

• For any non-zero v G V, the subsheaf F v := Ox • v C F satisfies 

length F v > n/2, (resp. length F v > n/2.) 

We denote by M^ 2 '^ the moduli space of semistable (F, V) with length F = n. If n is odd, 
the space M^ 2,n ^ is an algebraic space of finite type, and the integration of the Behrend 
function yields the DT-type invariant, 

DT(2,n)= / vd X - (1) 

When n is even, the space M^ 2 ' n - ) is an algebraic stack, and the integration such as ([I]) 
does not make sense. However we are also able to define the DT-type invariant, 

DT(2,n) GQ, 

when n is even by using the technique of the Hall-algebra. The existence of the above 
Q- valued invariant is one of the big achievement of the recent work of Joyce-Song [13]. 
We will give a brief introduction of the definition of DT(2, n) in Section [31 Let us consider 
the generating series, 

DT(2) = ^DT(2,n)g". 

Applying the wall-crossing formula of DT-invariants [T5] . [H], we show the following 
formula. 

Theorem 1.2. We have the following formula. 

DT(2) = ^M(q) 2 ^ - *ip-{M(q) x W . M(q)^ ■ N(q)} Al (2) 
where A C Z> is 

A = {(mi, m 2 , ra 3 ) G Z> : -m 3 < m x - m 2 < m 3 }. 
Let us explain the notation. The series N(q) is defined by 

N(q) :=q-^- log M(q) 

= E r V, 

r,n>0, r\n 

and for f lt / 2 , • • • , f N G Q [g] given by 

n>0 

and a subset A C Z> , the series {/i • /2 • • • /at}a is defined by 

i/l J2 JiV>A - a ni a ni a n N Q 

(ni,n2,-" ,njv)GA 

In the formula (JTHJ), we set iV = 3, fi = f 2 = M(g)^ x ) and / 3 = iV(g). 
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1.3 Integrality property 

Following [H], we introduce the invariant 

, . J DT(2,n), n is odd, 

{ , \ DT(2,n)-|DT(l,§), n is even. 

We also prove an evidence of the integrality conjecture by Kontsevich-Soibelman [TH 
Conjecture 6]. 

Theorem 1.3. We have Q(2,n) G Z for any nGZ, 

A first few terms of fi(2, n) are calculated as follows, 

J](2,0)=ft(2,l) = 0, 0(2,2) = -x, 

n(2,3) = -i( X 3 + 15 X 2 + 20x), 
o 

fi(2, 4) = -^( X 4 + 30 X 3 + 119 X 2 + 102 X ). 

We note that f2(2, n) are numbers which fill a part of the marks '?' in [HI Paragraph 6.5]. 
In the very recent paper by Stoppa [20] , the invariants have also been computed up to rank 
three. Especially he computed the invariants both using Kontsevich-Soibelman formula 
and Joyce-Song formula. He also show the integrarity of Kontsevich-Soibelman's BPS 
invariant up to rank three. 
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1.5 Notation and convention 

In this paper, all the varieties are defined over C. For a variety X, the abelian category of 
coherent sheaves on X is denoted by Coh(X). The bounded derived category of coherent 
sheaves on X, which forms a triangulated category, is denoted by D b (Coh(X)). For a 
triangulated category V, the shift functor is denoted by [1]. For a set of objects S C V, 
we denote by (S) tr C V the smallest triangulated subcategory of V which contains S. Also 
we denote by (S% x C T> the smallest extension closed subcategory of T> which contains 
S. For an abelian category A and a set of objects S C A, the subcategory (5') cx C A is 
also defined to be the smallest extension closed subcategory of A which contains S. 

2 Triangulated category of D0-D6 bound state 

Let X be a smooth projective Calabi-Yau 3-fold over C, i.e. 

K x = A 3 T* x ^O x , H\O x )=0. 



4 



We denote by Coh (X) the subcategory of Coh(X), defined by 

Coho(X) = {Ee Coh(X) : dimSupp(£) = 0}. 

In this section, we study the triangulated subcategory of D b {Coh.(X)) generated by Ox 
and objects in Coh (X), 

V x := (O x ,Coh (X)) tr C D\Co\x{X)). 

The triangulated category Vx is called the category of D0-D6 bound state in [HI Para- 
graph 6.5]. 

2.1 t-structure on T>x 

Here we construct the heart of a bounded t-structure on Vx- The readers can refer [6l 
Section 4] for the notion of bounded t-structures and their hearts. 

Lemma 2.1. There is the heart of a bounded t-structure Ax C Vx, written as 

Ax = (O x ,Coh (X)[-l]) cx . (3) 

Proof. Let T be the subcategory of Coh(X), defined by 

T '■= {E G Coh(X) : Hom(F, E) = for any F G Coh (X)}. 

Then (Coh (X),:F) is a torsion pair on Coh(X). (cf. [7j.) Let A* C D b (Coh(X)) be the 
associated tilting, 

A= (^,Coh (X)[-l]) cx . 

Note that A> is the heart of a bounded t-structure on D b (Coh(X)). (cf. [3 Proposi- 
tion 2.1].) It is easy to see the following. 

• We have 

A ] n D 6 (Coh (X)) = Coh (X)[-l], (4) 

in Z} 6 (Coh(X)). In particular the LHS of (jlj) is the heart of a bounded t-structure 
on D 6 (Coh (X)). 

• For any F G Coh (X), we have 

Hom(O x ,F[-l]) = Hom(F[-l],O x ) = 0, 

by the Serre duality. 

Then we can apply [221 Proposition 3.3], and conclude that Ax '■— A^ D is the heart 
of a bounded t-structure on V x , satisfying (j3J). □ 

The abelian category Ax C is described in a simpler way, as follows. 
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Proposition 2.2. The abelian category Ax given by |3j) is equivalent to the abelian cat- 
egory of triples 



(0?,F, 8 ), 



(5) 



where r is an integer, F G Coho(X) and s: Of —>■ F is a morphism in Coh(X). The set 
of morphisms from (Of, F, s) to (Of , F', s') is given by the commutative diagrams, 



" F 

Y 

F'. 



(6) 



The equivalence is given by sending a triple E = (O x , F, s) to the two term complex 

= > -> Of A F -> -> • • • G ^x, (7) 

where Of is located in degree zero. 



Proof. For a triple = (0® r , F, s) as in note that the two term complex given 
by ([7]) fits into the exact sequence in Ax, 







^x 



0. 



Let us consider a diagram Since Hom(C^ r , 1]) = 0, there is a unique morphism 
7: — > $(£") which fits into the commutative diagram, 











F[-l] *$(E) 



O 
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a 








■ 




*F[- 


-i]- 







X 



X 







0. 



(8) 



Hence E 1— > $(£') is a functor from the category of triples (jSJ) to *4x- Using the diagram 
© and Hom(F[-l], Of ) = 0, it is easy to see that $ is fully faithful. Hence it suffices 
to show that $ is essentially surjective. 

Let us take an object M G Ax- By ([3]), there is a filtration in Ax, 



M C Mi C • • • C M k 



M, 



such that each subquotient iVj = M»/Mi_i is isomorphic to Ox or an object in Coh (X) [— 1] 
We show that each Mj is quasi-isomorphic to a two term complex (J7J) by the induction on 
j. The case of j = is obvious. Suppose that M,-_i is isomorphic to a two term complex 
(Of A F) for F G Coho(X). There are two cases. 

Case 1. Nj is isomorphic to Ox- 
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In this case, we have the commutative diagram, 




F[-l] >■ Mf_i ,Of, 

since if 1 (Ox) = 0. Taking the cones, we obtain the distinguished triangle, 

F[-l] — > Mj — > Of +1 . 
Therefore Mj is quasi-isomorphic to a two term complex (Of +1 — > F). 
Case 2. Nj is isomorphic to F'[-l] for F' G Coh (X). 
In this case, we have the commutative diagram, 

F'i-2] 



F[-l]- — ^ Mj_i - -^0f, 

since Hom(F'[— 2], Of) = 0. Taking the cones, we obtain the distinguished triangle, 

F"[-l] — > Mj — ► Of. 

Here F" fits into the exact sequence of sheaves — > F — > F" — > i 7 " — >• 0, hence F" G 
Coho(X). Then Mj is quasi-isomorphic to a two term complex (Of F"). □ 

In what follows, we write an object E G Ax as a two term complex (C^ r — > F) 
occasionally. We set So, S x G Ax for x & X as follows, 

^ = (Ox^0), S x = (0^O x ). (9) 

The following lemma is obvious. 

Lemma 2.3. ^4n object E G simple if and only if E is isomorphic to So or S x for 

x G X. Any objects in Ax is written as successive extensions of these simple objects. 

2.2 Stability condition on Ax 

Here we discuss stability conditions on Ax, and the associated (semi)stable objects in 
Ax- The stability condition discussed here is based on the notion of stability conditions 
on triangulated categories by Bridgeland [5]. 

Let Ax C T>x be the abelian category given by (J3]). We set Y = Z © Z and a group 
homomorphism 

c\:K(Ax)^T, 

by the following, 

cl : (Of -> F) ^ (r, length F) . 
Also we denote by EI C C the upper half plane, 

M = {z eC: hnz > 0}. 
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Definition 2.4. A stability condition on Ax is a group homomorphism Z : T — > C, which 
satisfies 

Z(cl(£)) £ H, 

for any non-zero object E £ .4.x- 

In what follows, we write Z(cl(i?)) as for simplicity. 

Remark 2.5. 5?/ Lemma \2. 3\ a group homomorphism Z : T —>■ C is a stability condition 
on Ax if o,nd only if 

Z(l,0)eH, Z(0,1)GH. 
In particular the set of stability conditions is parameterized by points in H 2 . 

Remark 2.6. For a stability condition Z: T — > C on Ax, the pair (Z,Ax) determines a 
stability condition on V x in the sense of Bridgeland J^j. 

The notion of (semi)stable objects are defined as follows. 

Definition 2.7. Let Z: T — > C be a stability condition on Ax- We say E £ Ax is 

Z-semistable (resp. stable) if for any non-zero proper subobject C F C in .4.x, the 
following inequality holds, 

argZ(F) < argZ(_E), (resp. argZ(F) < argZ(E).) 

2.3 Semistable objects in Ax 

We fix three stability conditions on Ax, 

Z*:T^C, * = ±,0 (10) 

satisfying the following, 

argZ + (l,0) >argZ + (0,l), 
argZ (l,0) = argZ (0,l), 
argZ_(l,0) < argZ_(0,l). 

The set of Z*- (semi) stable objects are characterized as follows. 

Proposition 2.8. (i) An object E £ Ax is Z_- (semi) stable if and only if E is isomorphic 
to 

(0® r -^O) or (0->F), (11) 

for r £ Z and F £ Coh (X). (resp. isomorphic to Sq or S x for x £ X, given in §9\).) 

(ii) Any object in Ax is Zq- semistable, and E £ Ax is Z^-stable if and only if E is 
isomorphic to So or S x for x £ X . 

(Hi) An object E £ Ax is Z + - (semi) stable if and only if E is isomorphic to 07]) . 
(resp. Sq or S x for x £ X ,) or isomorphic to (O^ A F) with r > 0, F 0, satisfying 
the following. 
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The image of the induced morphism between global sections, 

V = lm{H°(s): C® r H°(F)}, (12) 
is r- dimensional and generates F as an Ox-module. 

For any non-zero proper subvector space C W C V, the subsheaf Fy/ := Ox • W C 
F satisfies 

length F\y length F ( length Fw _ length F 



I length b w length^ \ 
I resp. —— — — — — > . (Id) 



dimly r \ dimW 7 

Proof, (i) Take a non-zero object E G Ax, which is isomorphic to (O x r A F) for F G 
Coh (X). We have the exact sequence in Ax, 

— ► F[-l] — > E — ► Of — ► 0. (14) 

If r 7^ and F^O, then we have 

argZ_(F[-l]) > argZ_(£), 



hence (1141) destabilizes E. Therefore if E is Z_-semistable, we have r = or F = 0. 
Furthermore if E is Z_-stable, r = 1 or length F = 1 must hold. Hence E is isomorphic 
to So or S x for Conversely it is easy to see that objects in (ITT]) , (resp. S , S x for 

x G X,) are Z_-semistable. (resp. Z_-stable.) 

(ii) The proof of (ii) is obvious. 

(iii) Let us take a non-zero object E = (Of A F) G Ax- If r = or F = 0, it is 
easy to see that E is Z + -semistable, and it is furthermore Z + -stable if and only if E is 
isomorphic to Sq or S x for x G X. Therefore we assume that r ^ and F^O. 

Suppose that E is Z + - (semi) stable, and take V C H°(F) as in (fl2i) . If dimV < r, 
then there is an injection Ox ^ E in ^4x- Then we have 

argZ + (0 x ) >argZ + (£). 

This contradicts to that E is Z + -semistable, hence V is r-dimensional. Furthermore if V 
does not generate F as an Ox-module, there is a closed point x E X and a surjection 
E -» 1] in Since 

argZ + (£) >argZ + (a), 

this is a contradiction. Also take a subvector space C W C V and the subsheaf of F, 
F w = Ox ■ W C F. Then there is an injection in Ax, 

(O x ®c W -» F w ) £, 

hence the Z + - (semi) stability implies the desired inequality (IT31) . 

Conversely suppose that V is r-dimensional, generates F as an Ox-module and the 
inequality (ITBT) holds. Since V generates F, the morphism s : — > F is surjective, and 
E is a coherent sheaf. Take an injection in Ax, 

E' = (Of ^F')^E. (15) 
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If r' = r, then (fl5j) is an isomorphism since O x r F is surjective. If r' = 0, then 
aigZ + (E') < aigZ(E) is obviously satisfied. Let us assume < r' < r, and take 
F" = 1ms' C F' . Note that there are injections in Ax-, 

E" = (Of -» F") ^ E' ^ E. 

Since the cokernel of £" lies in Coho(X)[— 1], we have 

aigZ + {E') <axg Z+(E"). 

Also since 1/ is r-dimensional, the inequality ([TBI implies 

argZ + (£) > argZ + (£"), (resp. argZ + (£) > arg Z + {E").) 

By (TT6"j) and (TT7j) . the object E is Z + - (semi) stable. 



(16) 

(17) 
□ 



Remark 2.9. By Proposition \2.S\ (Hi), giving a Z + -semistable E 6 is equivalent to 
giving a pair (F,V), where F £ Coh (X) and V is a linear subspace V C H°(F) which 
generates F as an Ox-module, and satisfying the stability condition < T73j) . TTie notion of 
such pairs (F, V) also makes sense for non-projective Calabi-Yau 3-fold X . 

Example 2.10. (i) If r = 1, then (F, V) gives a Z + -semistable object if and only if V 
generates F as an Ox-module. Suppose that X = C 3 . The torus T = acts on X, and 
the T-invariant pairs (F,V) with length F = n bijectively corresponds to 3-dimensional 
partitions. For instance, the case of n = 3 is as follows, 



' C©Cx6 


BCx 2 




' c 


C®CyQ 






c 


C © Cz Q 


3Cz 2 


DV = < 


c 


C © Cx 6 


BQ/ 


c 


C©Q/6 


BCz 




c 




3Cz 




I c 



Here x,y,z are coordinates of C 3 . 

(ii) Suppose that X = C 3 and (r, n) = (2,3). In the notation of (i), the T-fixed 
Z + -semistable (F, V) are classified as follows. 



C © Cx © Cx 2 
C © Cy © cy 
C © Cz © Cz 2 
Cx © Cy © Cxy 
Cy © Cz © Q/z 
Cx © Cz © Cxz 



C©Cx 

C©Cy 

C©Cz 

Cx©Q/ 

Q/©Cz 

Cx©Cz 



2.4 Moduli stacks 

Here we discuss the moduli stack of objects in Ax and its substack of semistable object. 
For the notion of stacks, the readers can refer |15j . 
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Let Obj(Ax) be the 2-functor, 

Obj(Ax) '■ Sch /C — > groupoid, 

which sends a C-scheme S to the groupoid of objects £ G D b (X x S), which is relatively 
perfect over S and satisfies hi*S G Ax for any closed point s G S. (See [IE].) Here 
z s : X x {s} <^-> X x 5 is the inclusion. The 2-functor (96j(^4x) forms a stack, and we 
have the decomposition, 

Obj(A x )= J] Obj^ n \A x ), 
(r,n)er 

where C6j (r,n) (^lx) C Obj(A x ) is the substack of objects E e A x with cl(F) = (r,n). 

Let us show that Obj^ n \A x ) is an algebraic stack of finite type by describing it as a 
global quotient stack of the Quot scheme. For (r, n) G T, recall that the Grothendieck's 
Quot scheme [8] parameterizes isomorphism classes of quotients, 

Quot (n) (C® r ) = {Of 4> F : F G Coho(X), length F = n}/ . 

Here two quotients Of -» F and Of -» F' are isomorphic if and only if there is a 
commutative diagram, 



id = 

Of F'. 

In particular there are no non-trivial automorphisms, and the resulting moduli space 
Quot (n) (0® r ) is a projective fine moduli scheme. Note that there is a natural right 
GL(r, C)-action on Quot (n) (0f ), given by 

{Of X F ).g = {Of ^F). 

We set 

Uto = {(Of 4> F) G Quot (n) (£>® n ) | H°(s) : C n ^ H°(F)}. 

It is easy to see that is an open substack of Quot (n) (e>f n ). For an object F G Coh (X) 
with length F = n, let us choose an isomorphism C n = H°(F). By applying ®c®x and 
composing the natural surjection, 

Of S F°(F) ® c C x -» F, 

we obtain a point in tA n '. Such a point is obtained up to a choice of an isomorphism 
C n = #°(F), hence Obj {0 ' n) (A x ) is constructed as the quotient stack, 

Obj^ n) (A x ) = [f/ (n) /GL(n,C)]. 
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For r > 0, the moduli stack Obj( r ' n \Ax) is constructed as follows. Let Q G Coh(U^ xX) 
be an universal quotient sheaf restricted to U^ n \ and iiu : U^ n ' xl^ [/w the projection. 
We construct the affine bundle f/( r,n ) — > £/( n ) as 

tf< p ' n > = <Spec 0u(n) Sym-(7r^Q® r )* - C/H (18) 

It is easy to see that f/( r ' n ) represents the functor sending a C-scheme S to the set of 
isomorphism classes of the diagram, 

oRx -» r <- QTxx, (is) 

where is a coherent sheaf on SxX flat over S, and the induced quotient O x n — > JF|{ s } x x 
for each closed point s e 5 determines a point in U^ n \ There is a right GL(r, C)-action 
on f/( r ' n ) along the fibers of the morphism (jlSp . acting on the right arrow of ffT9|) . Also 
the right GL(n, C)-action on naturally lifts to the right action on U^ r,n \ and these 
actions commute. Hence there is a rig ht G^ := GL(r,C) x GL(n, C)-action on U^ n \ 
and the moduli stack Obj^ r,n \Ax) can be constructed as 

Obj {r ' n) (A x ) = [U {r ' n) /G (r ' n) ]. (20) 

In particular Obj^ r,n \Ax) is an algebraic stack of finite type over C. 

Proposition 2.11. For any p E U^ r,n > , there is a G^^' -invariant analytic open subset 
p G U p C f/( r ' n ) ; a C( r ' n ) -equivariant embedding U p C M p /or a complex manifold with a 
right G^ r,n ' -action, and a G^'^ -invariant holomorphic function f v : M p — > C such that 

U p = {z E M p : dfp(z) = 0}. 

Proof. Suppose that p G £/( r ' n ) corresponds to a diagram, 

_» F <- C® r , 

such that F G Coh (X) decomposes as 

F = F h Supp(F) = {a*}, length F t = n h 

i=i 

for distinct closed points x±, x-i, ■ ■ -Xi G X and U{ G Z. Let us take an analytic small open 
neighborhood Xi G Vi C X such that each Vi is isomorphic to C 3 as a complex manifold, 
and Vi PI Vj| = for z 7^ j. Note that we have 

p G {(O®" - F' <- Of) G f/ (r ' n) : Supp(F') C ]J V}, (21) 

i 

and define p E U p C U^ r,n ' to be the connected component of the RHS of (|2"T|) . which 
contains p. Obviously U p is G( r ' n )-invariant analytic open subset of U^ r ' n \ Restricting to 
each Vi, giving a point on U p is equivalent to giving a collection of diagrams, 

0{f -» <- 0g\ lengthen,, (22) 
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for each 1 < i < k such that the induced morphism 

k 



i=l i=l 



is an isomorphism. Since V{ = C 3 , giving such a collection of data (1221) is equivalent to 
giving a point 



{{x^z^i^Y^isf y j=1 )}li e n M ^( c ) x3 x ( c " ! ) n x ( cn! ) r ' ( 23 ) 



satisfying 



XiYi — YiXi, X{Zi — ZiXi, YiZi — ZiYi, 1 < i < fc, (24) 
det ( V (1) ,w (2) ,--- ,v (n) ) ^0. (25) 



Here Xj, F i; Zi are elements of M ni (C), v\ , are elements of C n \ and we have regarded 

g 0C n * =C n , 



i=l i=l 



as a column vector of M n (C). We set M p to be an open subset of the RHS of 
satisfying only (125]) . Then the zero set of the equation (1241) is the critical locus of the 
holomorphic function f p : M p — ■> C, 

/„ ({(x,, Fj, z«, {«? ) }y =ll {^I^JIL) = E M-xi^ - W). 

8=1 

Obviously G^ r ' n - ) acts on M p from the right, / p is G*- r, "^-invariant, and there is a 

G (r,n)_ 

equivariant isomorphism between U p and {df p = 0} C M p . □ 
Let Z: r — > C be a stability condition on Ax- Let 

,Vt c Obj^ n \A x ), (26) 



be the substack of Z-semistable objects E e with cl(-E') = (r, n). By Proposition [51 
we have 

M<r> n HZ-) = { 0b j lr ' n) ( Ax )> r = or n = 0, 
\ 0, otherwise. 

M^)(Z ) =C6j {r ' n) (^ x ). 
Here Z* is given by (llOp . The moduli stack A1^' n ^(Z + ) is described as follows. 

Lemma 2.12. There is a GL(r,C) -invariant Zariski open subs etQW C Quot (n) (C® r ) 
such that 

M (r ' n) {Z + ) = [Q (r ' n) /GL(r,C)]. 



13 



Proof. Let C £/ (r ' n) be the open subset corresponding to diagrams, 

0® n _» F A £>® r , 

such that s is surjective. Then the action of the subgroup {id} x GL(n, C) C G ? ( r > n ) on 
jj(r,n) j g f ree ^ anc j q UO tient space is 

£/ (r ' n) /GL(n,C) = Quot (n) (0® r ). 

We set Q (r,n) C Quot^ n ^(0^ r ) to be the subset corresponds to quotients C® r -» F such 

that the associated two term complex (O^ -» F) G .4.x is Z+-semistable. The sub- 
set Q( r,n ) is GL(r, C)-invariant, and it is straightforward to see that Q (r ' n) is open m 
Quot (n) (0® r ). (e.g. use the arguments of the openness of stability in [231 Theorem 3.20].) 
By ( 120]) . the quotient stack of Q^'^ by the action of GL(r, C) coincides with the desired 
stack M {r ' n \Z + ). □ 

3 Hall algebras and Donaldson-Thomas invariants 

In this section, we review the result of Joyce-Song [T3] applied in our abelian category 
A x . 

3.1 Notation 

In this subsection, we introduce some notation on algebraic groups, following [11]. Let G 
be an affine algebraic group over C with maximal torus T G . We say G is special if every 
principal G-bundles over C is locally trivial in the Zariski topology. For a subset S C G, 
the normalizer N G (S) and the centralizer Cc(S) of S in G are 

N G (S) = {geG: g^Sg = S}, 

Cg(S) = {g G G : sg = gs for all s G S}, 

and the centre of G is C(G) := Cg(G). For a subset S C T G , note that S C T G fl 
C(C G (S)). 

Definition 3.1. [TO Definition 5.5] We define the set Q(G, T G ) to be the set of closed 
C-subgroups S of T G , satisfying 

S = T G nC{C G {S)). 

We say G is very special if any S G Q(G, T G ) is special. 

It is shown in [HJ Lemma 5.6] that Q(G, T G ) is a finite set, and any S G Q(G,T G ) is 
written as an intersection of T G and Cc{{ti}) for a finite set of points t\, • • • , G G. 

Example 3.2. Suppose that G = GL(2,C), and G 2 m = T G C G is the subgroup of 
diagonal matrices. Then Q(G, T G ) consists of T G and the following subgroup, (cf. [Ti] 
Example 5.7].) 

G m = {( t M :t GC*1 CT G . (27) 



v x * , 

In particular GL(2, C) is a very special algebraic group. 
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In [TT], D. Joyce introduces an important rational number F(G,T G ,S) for a very 
special algebraic group G and S G Q(G, T G ), as follows. 

Definition 3.3. Definition 5.8], [11L Definition 6.7] Let G be a very special 
algebraic group. For S C S' in Q(G, T G ), we define n G G (S, 5") 6 Z to be 

n^(5,50= E (-l) |Ahl , 

S'eAc{s"eQ(G,TGy.s"cS'}, n s „ eA S"=s 



and for 5 G Q(G,T G ), define F{G,T G , S) G Q by 

iV G (T G ) 



F(G,T G ,5) = Jim J] 



S'&Q(G,T G ) 

scs' 



c G (S') n Nq(T' 



G) 



(S,S 



r\ Pt(S) 
Pt{C G {S')y 



Here for a quasi-projective C-variety Y", the virtual Poincare polynomial Pt(Y) G 
is defined by 

P t (Y") = £ dim(-l) fc H/ J (^(F,C))^, 

i,fc>o 

where W*(P^(K, C)) is the weight filtration on the compact support cohomology group 
H^(Y,C) introduced by Deligne. The existence of the limit t — > 1 is proved in [Til 
Theorem 6.6]. 

Example 3.4. For G = GL(2, C), it is easy to calculate F(G, T G , S) as follows, (cf. Ex- 
ample E2J [HI Paragraph 6.2].) 

P(G,T G ,T G ) = i F(G,T G , G w ) = -~. 



Here G m C T G is given by (jS 



3.2 Hall algebra 

Let X be a smooth projective Calabi-Yau 3-fold over C, and Ax C Dx the abelian 
subcategory given by ([3]). Here we introduce the Hall algebra based on the algebraic 
stack Obj(Ax), following [Til Definition 6.8]. 

Definition 3.5. We define the Q-vector space 7i(Ax) to be spanned by symbols, 

[X ± Obj(Ax)}, 

where X is an algebraic stack of finite type with affine geometric stabilizers, and / is a 
morphism of stacks, with relations as follows. 

• For a closed substack y C X and U = X \ y, we have 

[X i> Obj(Ax)] = [y f M Obj(Ax)] + [U f ^ Obj{A x )\. 
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• For a quasi-projective C-variety U, we have 

[ XxU Obj(A x )) = X (U)[X ± Obj(A x )). 
Here '■ X x U — >• X is the projection, and x(^0 = -ft(^)|t=i £ ^- 

• Let [/ be a quasi-projective C-variety and G a very special algebraic group, which 
acts on U with maximal torus T G . Then we have 

[[U/G]±Obj(Ax)} = F(G,T G ,S)[[U/S] f Z S Obj(A x )]. (28) 

SeQ{G,T G ) 

Here t s : [[// S] — *■ [U/ G] is a natural morphism. 

We denote by Sx(Ax) the stack of short exact sequences in Ax- There are morphisms 
of stacks, 

Pi : Ex(Ax) — > 06j(^a-), 

sending a short exact sequence — > A\ — > A 2 — > A 3 — > to objects respectively. There 
is an associative product on TC(Ax) based on Ringel-Hall algebras, defined by 

[X 4 06j(^)] * CV - 06j(^)l = & P ^ Obj(A x )}, 
where the morphism h fits into the Cartesian square, 

Z ^ £x(A x ) — ^ ^j(^). 

(PllP3) 

We have the following. 

Theorem 3.6. [9, Theorem 5.2] The ^-product is well- defined and associative with unit 
given by [SpecC — > Obj(Ax)) which corresponds to G *4x- 

3.3 Donaldson- Thomas invariant 

Let Z: r — > C be a stability condition on Ax- The embedding of the algebraic stack (|26i) 
defines an element 

5 (r ' n) (Z) = [7W (r ' n) (Z) c Obj(Ax)] e H{Ax). 

In order to define counting invariants of Z-semistable objects, we want to take a (weighted) 
Euler characteristic of the moduli stack MS T > n \Z). However in general, geometric points 
on the moduli stack MS T ' n >{Z) have non-trivial stabilizers, hence its Euler characteristic 
does not make sense. Instead we take the 'logarithm' of 5^ r,n \Z) in TC(Ax) to kill non- 
trivial stabilizers. 
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Definition 3.7. JT2], Definition 3.18] We define e^ n \Z) G H{A X ) to be 

e M)(Z)= ^ — 5 (ri ' ni) (Z)*---*5 (ri ' n;) (Z). (29) 

i>0, (ri,m)H h(n,nj)=(r,n), 

Z(ri,ni)6R>o.Z(r ) 7i.) for all i. 

Since 5( r ' n )(Z) is non-zero only if r > and n > 0, the sum (1291) is a finite sum. Also 
if r and n are coprime, then e^ n \Z) = 5^ n \Z). The important fact Corollary 5.10], 
[T0~1 Theorem 8.7] is that e^ r ' n \Z) is supported on 'virtual indecomposable objects', and 
written as 

m 

e (r,n ){z) ^J^cm x [SpecC/G m ] A Obj(A x )}, (30) 
1=1 

for quasi-projective C-varieties Ui, ■ ■ • ,U m , and ci, • • • , c m G Q. Now the (weighted) 
Euler characteristic of e^ r ' n '(Z) makes sense. 

Definition 3.8. Suppose that e G 7i(^4x) is written as 

m 

e = J2 c d U i x [SpecC/G m ] A Ofej(^x)]- (31) 
i=i 

For a constructible function /i: Obj(Ax) — > we define x( e ;/^) G Q to be 

m 

X(e,/i) = ^Q^xl/TV^O))- 

i=l fcez 

Next recall that for any C-scheme U, K. Behrend [I] associates a canonical con- 
structible function v. U — > Z, satisfying the following. 

• For p £ U, suppose that there is an analytic open neighborhood p G U p , a complex 
manifold M p with ?7 P C M p , and a holomorphic function / p : M p — > C such that 
^ = K P = 0}. Then 

Kp) = (-l) dimMp (l-x(M p (/ p ))). 
Here M p (f p ) is the Milnor fiber of / p at p. 

• If [/ has a symmetric perfect obstruction theory with zero dimensional virtual cycle 
U v ", we have 

/ 1 = / v d X . 

The notion of Behrend's constructible function can be easily extended to an arbitrary 
algebraic stack, (cf. [131 Proposition 4.4].) Hence we have the Behrend constructible 
function, 

v. Obj(A x )^Z. 
Explicitly using the notation of (1201 and Proposition 12.111 we have 

Kp) = (-l) n+r+ " r (l-x(M p (/ p ))), 

for p G £/ (r ' n) . We then define DT(r,n) G Q as follows, (cf. [EH Definition 5.13].) 
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Definition 3.9. We define DT(r, n) e Q to be 

DT(r,n)= X (e (r > n \Z + ),-v). 

Here we need to change the sign of the Behrend function. This is basically because 
that the Behrend functions on the variety M and on the stack M x [Spec C/G m ] have the 
different sign. 

Remark 3.10. (i) If r = 1, then DT(l,n) coincides with the Donaldson-Thomas invari- 
ant counting points, studied and calculated in Jffl$ . [P^j , |5]/ ; fTStf . The result is 

^DT(l,n)<f = M(-q) xix \ 

n>0 

where M(q) is the MacMahon function, 

m ^ = Ujt^- 02) 



k>l 



(ii) For n = 0, the invariant DT(r, 0) is easily shown to be (cf. fT3[ Example 6.2], [T4\ 
Paragraph 6.5],) 

DT(r,0) = i (33) 

(Hi) For r = 0, the invariant DT(0,n) is computed in \T3\ Paragraph 6.3], [Tfy Para- 
graph 6.5], 122} Remark 8.13] using the wall-crossing formula. The result is 



exp ( X^ -1 ^ -1 DT ( 0) n ) g " ) =M (^) 

\n>0 / 



(34) 



hence 

DT(0,n) = -*(*) ^2- ( 35 ) 

m>0,m\n 

3.4 Euler characteristic version 

In Section \5\ we will also use the Euler characteristic version of counting invariants of 
Z + -semistable objects in Ax, defined as follows. 

Definition 3.11. We define Eu(r, n) G Q to be 

Eu(r,n)= X (e^(Z + ),l). 
Here 1 is the constant constructible function on Obj(Ax) which takes the value at 1. 

Similarly to DT(r, n), the invariant Eu(r, n) is already computed when r = or n = 0. 
The result is (cf. p31 Example 6.2], [22 Remark 5.14],) 

Eu(r,0)= 1 J 2 , (36) 
Eu(0, n) = ^" ( 37 ) 

m>0,m\n 
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4 Computation of DT(2, n) 



In this section, we deduce the generating series of DT(2, n) using the wall-crossing formula 
of DT-invariants. 

4.1 Combinatorial coefficients 

In this subsection, we introduce some notation which will be used in describing the wall- 
crossing formula. For r = Z © Z, we set 



as follows. Suppose that vi, ■ ■ ■ ,vi e C(T) 1 satisfies one of (a) or (b) for each i, 

(a) fx(vi) > fJ,(v i+1 ) and n(vi H h v { ) > /i(v i+1 H h v t ). 

(b) fx(vi) < fji(v i+1 ) and fj,(vi H h v t ) < fx(v i+1 H h v t ). 

Then Si(v 1: • • • , v{) = (— l) k , where k is the number of % — 1, • • • , I — 1 satisfying (b). 
Otherwise s;(i>i, • • • , v{) — 0. 

Definition 4.2. For / > 1, we define the map 



C(r) = {(r, n) G T \ {0} : r > 0, n > 0}. 



Define C(r) — > Q U {oo} to be /i(r, n) = n/r. 



Definition 4.1. For I > 1, we define the map 



s,: c(r) 



{0,±1}, 



«i: c(r) 



Q 



as follows, 





\<i"<v<i 



4>: {1,- {l,-,!'}-{l,-,J"}, 
ip,£ are non-decreasing surjcctive maps, 
v(vi)=IJ.(vj) if ip(i)=^{j), 

ME fc6 ( S ov,)-iw ' l 'fe)=M(E fce ( e o^)-i( j ) ffc) for a °y »J- 




(38) 



We introduce the notion of bi-colored weighted ordered vertex, as follows. 



Definition 4.3. We call a data 



A = (V,7r,u,<), 



(39) 



bi-colored weighted ordered vertex if it satisfies the following. 



• V is a finite set. 



• 7r : V — > {•, o} is a map, where {•, o} is a set with two elements. 
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• v is a map v : V — > Z>i. 

• < is a total order on V. 

Let A be a data (I39p with I = \V\. The total order < on V gives an identification 
between V and {!,••• , /}. We set V, and V Q to be 



We set Vi G C(r) to be 



7, = {ve7: tt(u) = •}, 
K = {u G V : 7r(-u) = o}. 



(v(i),o), me v., 

(0, «(*))> ifieVa. 



We set s(A) G {0, ±1} and u(A) G Q to be 

s(A) = s z (fi, •••,«{), w(A) = • • ■ , v{). 

Also we set 



r(A) = ^v(i), n(A) = £)v(i). 
iev. ieVo 

We define DT(A) G Q and Eu(A) G Q to be 

DT(A) = J] DT(^), 0) J] DT(0, v(z)), 

Eu(A) = JJ Eu(«(z), 0) JJ Eu(0, 

Definition 4.4. Let A = ( V, 7r, t>, <) be a bi-colored weighted ordered vertex. We define 
the set £(A) to be the set of data 

(E,s,t), 

satisfying the following. 

• E is a finite set and s, t are maps E — > V, i.e. the data (V, i?, s, t) determines a 
quiver. The geometric realization of this quiver is connected and simply connected. 

• For any e G E, we have 7rs(e) 7^ 7rt(e). 

• For any e G we have s(e) < t(e) with respect to the total order < on V. 
For (E, s,t) G £(A), we set £J._+ to be 

£._> = {e G £ : 7rs(e) = •}. 
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4.2 Combinatorial descriptions of DT(r, n), Eu(r, n) 

Using the combinatorial data given in the previous subsection, we can describe the in- 
variant DT(r, n) as follows. 

Theorem 4.5. We have the following formula. 

DT(r,n)= ^ (— l) rn u(A) DT(A) 

A=(V,7T,v,<) is a bi-colored 
weighted ordered vertex with 
r(A)=r, n(A)=n. 

(-l) lvl 1 e (- i ) ii? - i n^( e )) u w e ))- ( 4 °) 

Proo/. Let x: T x T ^ Z be 

x((r, n), (r', n)) = rn' — r'n. 

For E,F e .4.x, we have 

x(cl(£),cl(F)) = dimHom(£,F) - dim Ext 1 F) 

+ dimExt 1 (F,£) -dimHom(F,£), (41) 

by the Riemann-Roch theorem and the Serre duality. The equation (PLtl) provides an 
analogue of [13, Equation (39)] and Proposition 12.111 provides an analogue of [131 Theo- 
rem 5.3]. The proof of the Behrend function identity given in [T3], Theorem 5.9] depends 
on these two properties, hence the analogue of [13, Theorem 5.9] also holds for our abelian 
category Ax- Then we can apply the proof of [EU Theorem 5.16] for stability conditions 
Z±: r — > C, and obtain the same formula given in [TSJ Theorem 5.6]. Noting that 

X ((r,0),(r',0)) = 0, X ((0, n), (0, n')) = 0, 

we obtain the formula (|40l) . □ 

The formula for Eu(r, n) is similarly obtained by using [T2"j Theorem 6.28] instead 
of [T3"| Theorem 5.16]. 

Theorem 4.6. We have the following formula. 

Eu(r,n)= V u(A)Eu(A) 

A=(V,n,v,<) is a bi-colored 
weighted ordered vertex with 
r(A)=r, n(A)=n. 

(±Y 1 £ (-1)1^-1 U«(a(e))t;(t(e)). (42) 

^ ' (S,s,t)6£(A) ee_B 

As a corollary, we have the following. 
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Corollary 4.7. We have 

DT(r, n) = (-1)™+-! Eu(r, n). (43) 

Proof. By the formulas (1531). (j35p . (1561) and (1371). we have 

DT(A) = (-l) |y|+r Eu(A), 

for a bi-colored weighted ordered vertex A = (V, n, v, <) with r(A) = r. Applying formulas 
(HUD and (H2D, we obtain (T43J). □ 



4.3 Computation of s(A) 

In this subsection, we compute s(A) for a data (139]) with r(A) = 2. Let us take a data 
PI) with \V\ = I and 

r(A) = 2, n(A) = n. (44) 

We fix an identification between V and {1, • • • , /} induced by the total order <. We 
denote by tt(A) the sequence of • and o, given by 

tt(A) = tt(1) tt(2) ••• 7r(0- 

Note that we have |V^| < 2. We first have the following lemma. 

Lemma 4.8. Suppose that 7r(l) = n(2) = o, Le. 7r(A) zs 

1 2 

o o • • • o • • • • . 

Then s(A) = 0. 

Proof. Since /i(fi) = ^(^2) and 00 = > /i(t>2 + • — h vj), (v 1, • • • , f;) does not satisfy 

(a) nor (b) in Definition 14.11 □ 

Next we compute the case of \V m \ = 1. 

Lemma 4.9. Suppose that \V,\ = 1 with s(A) 7^ 0. T/ien i/ie uaZue s(A) is computed as 
follows. 

• Suppose that 7r(l) = o ; tt(2) = • and 7r(«) = o for all i > 3, i.e. vr(A) is 

o • o ■ ■ • o . (45) 

T/ien s(A) = (-1)'. 

• Suppose that 7r(l) = • and 7r(i) = o /or a// z > 2, i.e. 7r(A) is 

• o o • ■ ■ o . (46) 

T/ien s(A) = (-1)'" 1 . 
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Proof. By Lemma fl~8l the sequence {vr(l), 7r(2), ■ • • , 7r(Z)} is either fj45|) or fj46|) . In case 
(T4"5"]) . (resp. (T4"6l) .) the condition (a) or (b) in Definition 14. II is satisfied and the number of 
1 < i < I — 1 in which (b) holds is Z — 2. (resp. I — 1.) □ 

The case of |V,| = 2 is computed as follows. 

Lemma 4.10. Suppose that \V,\ = 2 with s(A) ^ 0. Then I > 3 and s(A) is computed as 
follows. 

• Suppose that V, = {1,2} ; i.e. tt(A) is 



1 2 Z 
• • O • • • O 



(47) 



Then s(A) = 

Suppose that V, = {1, a} for a > 3, i.e. 7r(A) is 



1 2 a-l a a+1 Z 
• O ••• O • O O 



(48 



T/ien we /mve 

u(2) + u(3) + ■ • • + v{a - 2) < v(a - 1) + v(a + 1) + • • • + u(Z), 
u(2) + u(3) + • • • + v{a - 2) + v{a - 1) > v{a + 1) + • • • + v{l), 

and s(A) = (-1)'. 

Suppose that V, = {2,3} ; i.e. tt(A) 



1 2 3 4 j 

o • • o • • • o 



(49) 



T/ien we have v(l) < v(4) + • • • + v(l) and s(A) = (— 1)'. 
Suppose that V, = {2, a} /or a > 4, ie. 7r(A) «s 



12 3 a-l a a+1 Z 
O • O ••• O • O O 



(50) 



Then we have 

v(l) + v{3) H Vv{a - 2) < v(a - 1) + v(a + 1) H h u(Z), (51) 

u(l) + u(3) + • • • + v(a - 2) + v(a - 1) > v(a + 1) + • • • + (52) 

and s(A) = 

Proof. By Lemma l4~8| the sequence tt(A) is one of (jl7|) . (jlHD, dlSD, (T50|) . In each case, 
s(A) is easily computed by Definition 14.11 For instance, let us consider the case (1501) . 
Since fi(v a _ 2 ) < K v a-i) and K v a-i) > K v a), we nave 

/u(wi + w 2 H 1- U0-2) < K v a-i H hfz), (53) 

//(t>i + f 2 H h fa-2 + v a -i) > fi(v a H h vi). (54) 

Since v 2 = v a = (1,0), the conditions (1531) . (154]) are equivalent to (15T1) . (152]) respectively. 
Conversely if conditions (15T1) . (152|) are satisfied it is easy to check that one of (a) or (b) 
in Definition 14.11 holds at each 1 < i < I — 1. In this case, the number of 1 < i < i — lin 
which //(i>i) < /i(fj+i) holds is Z — 3, hence s(A) = (— l) i_1 . □ 
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4.4 Computation of u(A) 

In this subsection, we compute u(A) for a data (|39|) satisfying (jUj). We fix an identification 
between V and {1, 2, ■ • • , 1} via <. Let us take 1 < /' < / and a map 

V: {1,2,-.. ,Z}-»{1,2,.-. ,/'}, (55) 

which appears in (1551) . Note that 7r(i) = ir(j) if ^>(i) = ^(j), hence the map tc descends 
to the map 

tt': {!,... ,/'}^{.,o}, (56) 
via ip. We set v' : {!,••• , I'} — > 1>>\ to be 



v'(i) 



jgV'~ 1 («) 



Then the data 



A' = ({1,---,Z'},7T>',<) 



is a bi-colored weighted ordered vertex. The map ip descends to the map of the sequences 
7r(ip): 7r(A) — > ir'(A'). First we compute the case of |V.| = 1. 

Lemma 4.11. Suppose that V, = {a} for 1 < a < I. Then we have 

" (A > = { a-~m-a)y (57) 

Proof. In this case, we have v(a) = 2 and the number I" which appears in fl38l) must be 
1. For a map fl55|) . the map 7c(tp) : 7r(A) — > 7r'(A') is either one of the following forms by 
Lemma I4.8[ 

i 

• o • • ■ o •■■ o • • • o 

• o • • • o 

a 

O • • • O • 0---0 ••• O • • • O 

^ ^ i- i- i- i- 



For simplicity we calculate the case of a > 2. The case of a = 1 is similar. By the 
definition of U\ in fl38l) and using Lemma 14.91 we have 

V 7 xl>: {a+l,-,l}->{3,-,l'}, i=l lr Wl 

is a non-decreasing 
surjective map. 

Then we apply Lemma 14.121 below and conclude (I5T|) . □ 
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We have used the following lemma, whose proof is written in [T2j Proposition 4.9]. 
Lemma 4.12. For any I > 1, we have 

V 



d-V 



V>0, ip: {1,- ,/'}, 
tp is a non-decreasing surjective map. 



n^— =-. 



Next we compute u(A) when |V,| =2. We write V, = {a, b} for 1 < a < b < I. Note 
that we have 

v (a) = v(b) = 1, I" < 2. 

Here I" is a number which appears in fl38l) . When 6 — a > 3, the coefficient u(A) does not 
contribute to the sum (|4T)1) by the following lemma. 



(5f 



Lemma 4.13. Suppose that V, = {a, b} with b — a > 3. Then we have 

(E,s,t)eS(A) e£E 



Proof. Take (E,s,t) G £(A). Since the quiver (V,E,s,t) is connected and simply con- 
nected, there is unique a < i < b and e,e' G E such that 

s(e) = a, t(e) = s(e') = i, t(e') = b. 

Since b — a > 3, there is a < j < b such that j ^ i. Since (V, s, t) is connected, there 
is e" G such that either (s(e"),t(e")) = (a,j) or (s(e"),t(e")) = (j,b) holds. Suppose 
that (s(e"), £(e")) = (a,j) holds, i.e. the geometric realization of the quiver (V,E,s,t) is 
as follows, 




Note that by the simply connectedness of (V, E, s,t), there is no e'" G E which satisfies 
(s(e"'),t(e"')) = (j,b). We set E' to be the set 

£'=(^{e"})II{e'''}, 

and define maps s',t': E' — > V so that s'|£\{ e "} = s\E\{e"}, ^'|B\{ e "} = t\E\{e"}, and 
(s(e w ), t{e"')) = (j,b). The geometric realization of the quiver (V,E',s',t') is as follows, 




Since v(a) = v(b) = 1, we have 

(-1)1*— >l Y[ v(s(e))v(t(e)) + J] v(s'(e))v{t'{e)) = 0. 



Therefore the sum (1581) vanishes 



□ 
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We compute u(A) when b — a < 2. Let us divide it (A) into the following sum, 

w(A) = u (1) (A) + m (2) (A) + u (3) (A). 
Each wW(A) is the following. 

• «W(A) is defined by the sum (JMD with Z" = 1 and ip : {1, ■••,/} -> {1, •■ ■ , Z'} 
satisfying [vr = 2. Here 7r': {1, •••/'}—> {•, o} is given by (|56|) . 

• n^(A) is defined by the sum (JMD with I" = 1 and ip : {1, • • • ,1} -> {1, • • • , Z'} 
satisfying [vr = 1- 

• u (3) (A) is defined by the sum (JMD with Z" = 2. 
We compute «W(A) as follows. 

Lemma 4.14. (i) Suppose thatV, = {a,a+l} for 1 < a < Z — 1. Then (A) is non-zero 
if and only if 

v(l) + • • ■ + v(a - 1) < v(a + 2) + • • ■ + u(Z). 

In case, we have 

(-!)'-« 



W(A) 



(a - l)!(/-a - 1)! 



(m,) Suppose that V, = {a, a + 2} /or 1 < a < / — 2. T/ien w^(A) is non-zero if and only 
if 

v(l) H h f (a — 1) < f (a + 1) + v(a + 3) H h «(/), (59) 

f (1) + • • • + v(a - 1) + v(a + 1) > v(a + 3) + h u(Z). (60) 

In t/ws case, we have 

(_-> \l-a-l 

u( "' A » = ( a -i) l( i- a -2)r (61) 

Proof. The computations of (i) and (ii) are identical, so we only check (ii). Let if): {1, • • • , Z} 
{1, • • • , /'} be a map which appears in (I3"8|) . By Lemma ETSl the map 7r(^) : 7r(A) — > 7r'(A') 
is one of the following forms, 

1 3 

• o • o • • • o ■■• o • • • o 

a= 1 I I I | I 

• o • o • • • o 

a a+2 

O • • • O • O • O • • • O ••• O • • • O 

a>2 | | | | [ i 

o • o • o • • ■ o 
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For simplicity we calculate the case of a > 2. By Lemma 14.101 we see that «W(A) is 
non-zero only if fl59|) and fl60l) hold. By Lemma [4.101 and fl38l) . we have 

v y V>: {a+3,-,0-»{5,-/}, i=5 lr Wl 

i/> is a non-decreasing 
surjective map. 

Applying Lemma [4 .121 we obtain fl6Tl) . □ 

The computation of ix^(A) is as follows. 

Lemma 4.15. VFe /iawe u^(A) ^ if and only ifV, = {a, a+ 1} /or some 1 < a < I — 1. 
In this case, we have 

/_1 y-o-i 

M,2, ( A » = 2(a - !)!(/ -a- I)! ' < 62 > 

Proof. Suppose that «( 2 )(A) 0. By the definition of it^(A), it is obvious that V. = 
{a, a + 1} for some 1 < a < I — 1. By Lemma [4. S\ the map 7r(V>) : tt(A) — > 7r'(A') is one of 
the following forms, 

1 2 

• • O • • • O ••• O • • • O 

• o • ■ ■ o 

a a+1 

O • • • O • • O • • • O ••• O • • • O 

i- i- i' i- 

o • o • • • o 

For simplicity we treat the case of a > 2. By Lemma Ei~9l and the definition of u^ 2 \A), we 
have 

V 7 i,: { a +2,-,l}^{3,-,l'}, *=3 1 ^ Wl 

^ is a non-decreasing 
surjective map. 

Applying Lemma [4.121 we obtain (RjiZl) . □ 

Finally we compute m^(A). 

Lemma 4.16. (%) Suppose thatV, = {a, a + l} for I < a < l — l. Then u^ 3 ' (A) non-zero 
if and only if the following condition holds, 

v(l) + v(2) + ■ ■ ■ + v(a - 1) = v(a + 2) + • • • + v(l). 

In this case, we have 

r— iv _a 



2(a - l)!(/-a - 1)!' 
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(ii) Suppose that V, = {a, a + 2} for 1 < a < I — 2. Then u^ 3 ^(A) is non-zero either 
one of the following conditions holds, 

v{l) + ■ ■ ■ + v{a - 1) = v(a + 1) + • • • + v{l), (63) 
v{\) + • • • + v{a - 1) + v {a + 1) = v(a + 2) + • • • + v{l). (64) 

If (EI)) (resp. (64\)) holds, then we have 

" W < A > = 2( B - !)!(«- .-!)! ■ H' 2 (n -!)!(/- a -I)! '] < 65 > 

Proof. The computations of (i), (ii) are identical, so we only check (ii). Suppose that 
«( 3 )(A) ^ and let ^: {1, • • • , 1} -»• {1, • • • , /'} and£: {1, • • • ,/'} -► {1,2} be maps which 
appear in the sum (1381) . By the definition of m^ 3 ^(A), the subset (ip o £) _1 (z) contains an 
element of V. for i = 1, 2. Therefore (ip o £) _1 (1) is one of the following, 

(V> °0 _1 (1) = {1,2, ...,a}, (66) 
(^o0- 1 (l) = {l,2,---,a,a + l}. (67) 

If fl66l) (resp. (jBTjl ) holds, then the condition (163]) (resp. fl64|) ) holds. For simplicity we 
treat the case in which fl66l) holds. The map : 7r(A) — > tt'(A') together with the map 
£ is as follows, 

O • • • Oj 

I 

o) 



By Lemma [4.91 and the definition of u^(A), we have 











a+2 




o ■ ■ • 


• 


S) 


(° 


• 


o • • • o 


1 




1 


1 


i 


i 


(° 




•) 


(° 


• 


o 




It 








it 




1 








2 



2 (a - 1)! ^ v i! U-i(f)ir 

ip is a non-decreasing 
surjective map. 

Applying Lemma [4.121 we obtain (|65|) . □ 
4.5 Generating series of DT(2, n) 

Combining the calculations in the previous subsections, we compute DT(2,n). We divide 
DT(2,n) into the following four parts, 

DT(2, n) = DT (0) (2, n) + DT (1) (2, n) + DT (2) (2, n) + DT (3) (2, n). 
Each DT w (2,n) is the following. 
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• DT (0) (2 , n) is defined by the sum fj4"0l) for bi-colored weighted ordered vertices A = 
(V, 7r, v, <) with r(A) = 2, n(A) = n and | V.| = 1. 

• For 1 < i < 3, DT^(2, n) is defined by the sum ( I40p for bi-colored weighted ordered 
vertices A = (V, 7T, v, <) with r(A) = 2, n(A) = n, |Vi| = 2, and w(A) is replaced by 
uW(A). 

We define the generating series DT (i) (2) by 

DT W (2) = ^DT (i) (2,n)g n . 

n>0 

In what follows, we compute DT' ! '(2). Recall the definition of the MacMahon function 
M(q) given in (|32l). 



Lemma 4.17. We have the following formula. 

DT (0)( 2 ) = lM(g) 2x W. (68) 

Proof. Let A = (V, n,v, <) be a bi-colored weighted ordered vertex with |V| = I and 
V, = {a} for 1 < a < I. Obviously the set £(A) consists of one element (E,s,t) G £(A), 
whose geometric realization is as follows, 



Note that we have |-E,^ | = I — a. By Remark 13.101 Theorem 14.51 and Lemma [4.111 we 
have 

1>1, l<a<l, v ' y ' i^a 

v. {I,- ,1}->Z> X , 
v(a)=2. 



I 



= \ E ilI(-2t;(i))DT(0,t;(i)) g o W (69) 

l>0 : ' i=l 

u: {1,- ,1}^Z>!. 

= |e X p(^-2nDT(0,n)g n ) 

\n>0 / 

= \M{q)^ x \ (70) 

Here we have used the following in flBT?]) . 

^ 1 11 

^ (a-l)\(l-a)\'2^- (7^1)!' 

and the formula ([31]) in ([70]). □ 
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Next let us compute DT^(2). We introduce the following notation. We define the 
series N(q) to be 

N(q) :=q-^\ogM(q) 

n>0, r\n 

q\ given by 

n>0 



For series /i,/ 2 ,-- - , /iv e 



and a subset A C Z> , we define the series {fi ■ f% • ■ ■ /n}a to be 
{/i • I-i ■ ■ ■ /\ }a E • : ' • 

(ni,ri2,--- ,njv)GA 

Lemma 4.18. We have the following formula, 



aWa®---ai N Jq ni+n2+ '" +nN - 



DT (i)( 2 ) = -^l{ M {q) x{x) ■ M(q) x W ■ N{q)} A . 



Here A C Z3> is 



(71) 
(72) 

A = {(mi, m 2 , m 3 ) G Z| : -m 3 < mi - m 2 < m 3 }. (73) 

Proof. Let A = (V, 7r, f , <) be a bi-colored weighted ordered vertex with r(A) = 2, n(A) = 
n and |V.| = 2. Let | V| = / and we identify V and {1, • - • ,1} via <. By Lemma 14.131 the 
data A contributes to (|40l) only if one of the following conditions hold. 

• We have V, = {a, a + 1} for 1 < a < I — 1. In this case, there are two types for 
(£,s,t)e£(A). 

Type A: There is unique 1 < c < a — 1 and e, e' G E such that 

s(e) = s(e') = c, £(e) = a, t(e') = a + 1. 

In this case, we have |-E._> | — I — a — 1. If we fix such c, there are 2 z_3 -choices of 
such (E, s,t) G ^(A). One of their geometric realizations is as follows, 




Type B: There is unique a + 2 < c < I and e, e' G such that 

t(e) = t(e') = c, s(e) = a + 1, s(e') = a. 

In this case, we have |-E,_>o| = I — a. If we fix such c, there are 2 z_3 -choices of such 
(E, s,t) G £(A). One of their geometric realizations is as follows, 
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We have V, = {a, a + 2} for 1 < a < I — 2. In this case, we call an element 
(E,s,t) G S(A) as Type C. 

Type C: There is e, e' G E such that 

s(e)=a, t(e) = s(e') = a + 1, t(e')=a + 2. 

There are 2 z_3 -choices of (E,s,t) G £{A). One of their geometric realizations is as 
follows, 




We write DT (1) (2) as 

DT (1) (2) = DT2 } (2) + DT^ 1} (2) + DT^(2), 

where DT^(2), DT^(2) and UT§ ) (2) are contributions of (E,s,t) G S(A) of type A, 
B and C respectively. Using Lemma 14.141 (i) and Theorem 14.5} the series DT^(2) is 
computed as follows, 



DT«(2) 



E 



1>1, l<a</-l, l<c<a-l, 
v. {1,- ,Z}->Z>i, «(a)=«(o+l)=l, 
u(l)H |-i;(a-l)<v(a+2)H ht)(Q- 



l-l 



1 

4 



E 



a>0, fe>0, fc>l, i=l 
«: {l,-,o}-»Z>i, {1,- ,6}-»Z>i, 
u(l)+-+t>(a)+fc<v'(l)H hf'(fe). 



if[(-i;(i))DT(0,i;(*)) g B W 



1 6 

• - H(-v'(i)) DT(0, <;(z))g*'« • (-fc 2 ) DT(0, k)q k 

i=l 



x£l{M(q)xW ■ M( g )*<*> ■ N(q)} AA . 



(74) 



Here A^ is defined by 



Aa = {(mi, m 2 , m 3 ) G Z> :mi+m 3 < m 2 }, 



and we have used the formula (1351) in (|74p . Using Lemma T4.141 similar computations show 
that 

DT«(2) = -^!{M{qY^ ■ M(q) x(x) • N(q)} Al3 , 
DT g) (2) = _xi^) {M{q)x (x) . M{q) x(x) . 7V(?)}a) 
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where A# is defined by 

A B = {(mi, m 2 , m 3 ) G Z| : m x < m 2 + m 3 }, 
and A is defined by (173"j) . Noting that 

A B = A A ]jA, 

we obtain the formula (1721) . □ 

Finally we show that DT^(2) vanish for i = 2, 3. 

Lemma 4.19. PFe have DT (l) (2,n) = /or any n > and z = 2, 3. 

Proof. Let A = (V, 7r, v, <) be a bi-colored weighted ordered vertex with r(A) = 2, \V\ = I, 
and take (E,s,t) G £(A). By Lemma 14.131 we may assume that V. = {a,a+ 1} or 
V. = {a, a + 2} for some 1 < a < I — 1. Let us consider the following data, 

A* = (V,vr, *;,<*), (E,s*,f), 

by setting <*, s* and t* to be 

a <* p if and only if a > (3, s* = t, t* = s. 

Then it is obvious that (E,s*,t*) 6 S(A*). For instance, the relationship between geo- 
metric realizations is as follows, 

(A,E,s,t) : 



(A*,E,s*,t*) : 




Note that if V, = {a, a + 1}, then (E, s, t) is of type A (resp. B) in the proof of Lemma 14. 181 
if and only if (E*,s*,t*) is of type B (resp. A). Also if V, = {a,a + 2}, then A satisfies 
(E2]), (resp. (1M1) ) if and only if A* satisfies ( 1M|) . (resp. (1BB1) .) Hence the map 

(A, (iW))^(A*,(£ )S *,t*)), 

is a free involution on the set of pairs (A, (E,s,t)) for data (1391) satisfying V. = {a,b} 
with < 6 — a < 2 and (E,s,t) G £(A). Using the computations of u^(A), u^(A) in 
Lemma 14.151 and Lemma 14.161 it is easy to check that 

(-1)1*— l w W(A) + (-1)I B -°I M «(A*) = 0, 

for % = 2, 3. Therefore DT (i) (2, n) = for any n > and i = 2, 3. □ 
Summarizing Lemma 14.171 Lemma 14.181 and Lemma 14.191 we obtain the following. 
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Theorem 4.20. We have the following formula. 

DT(2) = ^M(g) 2 *^ - *ffi{Af(g)*W ■ M(g)*W ■ N{q)} A , (75) 

for A = {(mi, 777-2, m z) £ Z> : — m 3 — m l — m 2 < m 3}- 

Remark 4.21. 5y Corollary \4-7\ and Theorem ^. 20\ we have 

^Eu(2,n)g n = -^M(g) 2 * (x) + ^^{M(g)* (x) ■ M(g)* (x) ■ iV(g)} A , 

n>0 

/or A = {(m 1; m 2 , m 3 ) G Z> : — m 3 < mi — m 2 < m 3 }. 

5 Integrality property 

In this section, we study the invariant 0(2, n) G Q, defined as follows. 
Definition 5.1. We define 0(2, n) G Q to be 

, n f DT(2,n), n is odd, 

l ' J \ DT(2,n)- |DT(l,f), n is even. 

By Corollary 14. 7\ the invariant 0(2, n) is also written as 

nfo ^ / -Eu(2,n), n is odd, 

£2(2, n) = < / nft 76 

I -Eu(2,n) - l=^Eu(l,f), n is even. 

In this section, we show the following result, which is an evidence of the integrality 
conjecture by Kontsevich-Soibelman [TJ1 Conjecture 6]. 

Theorem 5.2. We have 0(2, n) G Z. 



It seems that Theorem 15.21 is not obvious from the explicit formula (IToj) . Instead of 
using ()75p . we give a geometric proof of Theorem 15.21 using the definition of DT(2, n). 

Let Q( 2 ' n ) C Quot (n) (C| 2 ) be a GL(2, (C)-invariant Zariski open subset constructed in 
Lemma 12. 121 By Lemma 12.12} there is a smooth morphism 

/: Q (2 ' n) -> C6j (2 ' n) (^ x ). 

For p G Q^ 2,n \ we denote by E p G -4x the object corresponding to f(p) G Obj^ 2 ' n \Ax)- 

By the definition of DT(2, n), it is obvious that 0(2, n) G Z when n is odd. Therefore 
in what follows we set n = 2m for m G Z. We take a GL(2, (C)-invariant stratification of 

Q(2,2m) 



g (2,2 m ) = g (2,2 m ) "Q g (2,2 m ) "Q g (2,2 m ) "Q g (2, 2m) g ( 



i(2,2m) 

V — VO J J_Vl J J_V3 JJ_^ 

as follows. 
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Qq ' corresponds to p G Q^ 2m ^ such that E p G Ax is Z + -stable. 

QY' 2m ) corresponds to p G Q( 2,2rn ^ such that E p G Ax fits into a non-split exact 
sequence 



— >Ei 



Ei 



0. 



(77) 



for Z + -stable Ei G Ax with cl(.E'j) = (1, m) and £4 is not isomorphic to E 2 . 

• Q^' 2m ^ corresponds top 6 Q^ 2m ^ such that E p G .4.x is isomorphic to E\ © E 2 for 
Z + -stable G Ax with cl(-Ej) = (l,m) and Ei is not isomorphic to E 2 . 

• Q^' 2m ^ corresponds to p G QC 2,2 ™ 1 ^ such that E p G .4^ fits into a non-split exact 
sequence ( 1771) such that £1 = E 2 . 

• Q^' 2m ^ corresponds to p G Q <y2,2m ^ such that G .4^ is isomorphic to Ef 2 for a 
Z + -stable E\ G .4x- 

Then we can write S^ 2m \Z + ) G as 



i=0 



where 5,- is 



Si 



(2,2m) 



GL(2,C) 

- Q (2,2mY 



Obj (A 



X, 



Obj (A 



x, 



3 
4 



(2,2m) 



x , 



Here we have used the relation fl28|) and Example 13.41 

Lemma 5.3. TTie element 5 {l ' m) {Z + ) * 5^ m) (Z + ) G H{A X ) is written as 

4 

5^ m \Z + )*5 {1 ' m) {Z + ) =J2^ 



i=i 



where each Si is as follows. 

5 2 
S 3 
5, 



P(Ext 1 (E p2 ,E pi )) 



(pi,P2)eQ( 1 - m 'xQ( 1 ' m )\D 

(g( 1 - m ) x qM) \ d 



Obj (A 



x. 



pg Q(l,m) 

g(l,m) 



A 1 x GL 



^(Ext 1 ^,^)) 
A 1 x G m 

+ Obj(A x ] 



Obj (A 



X, 



Obj (A 



x, 



dp,, 



(78 



(79) 



(80) 
(81) 
(82) 
(83) 
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Here D C Q (1 ' m) x Q( 1 - m ) is a diagonal, the algebraic groups in the denominators act 
on the varieties in the numerators trivially. The measure p, for the integrations / fgQj) . 
(EJ|) sends constructible sets on Q^' m ^ x Q\ x > m > or Q( 1,m ) to the associated elements of the 
Grothendieck group of varieties. 

Proof. Recall that 5 <Kl,m \Z + ) * 5^ l,m \Z + ) is defined by taking the fiber product of the 
following diagram, 

Sx(Ax) (84) 

[Q^/G m ] x [Q^/GJ ^Obj(A x ) x Obj(A x ). 

Here G m acts on Q^ l ' m "> trivially. Take C-valued points pi - . SpecC — > Q^' m > for i = 1,2, 
which corresponds to Ei G Ax- We have the associated elements in the Hall- algebra, 



fi 



Then f\ * f 2 is as follows, 
fi * f'2 



[SpecC/G m ] A [Q (1,m) , 
Ext 1 (E 2 ,Ei) 



Ob j {A 



Eom(E 2 ,E 1 ) x G^ 



Ob j (A 



x, 



15) 



Here (ti,t 2 ) G G^ acts on Ext 1 (S 2 , -^i) and Hom(S 2 , -^i) via multiplying M^ 1 , and 
Hom(£ 2 ,-Ei) acts on Ext^E^, -^i) trivially. For u G Ext 2 (£ , 2, -Ei), the stabilizer group of 
the G^-action on Ext 1 (E 2 , E\) at u is G^ if u = and the diagonal subgroup G m C G^ 
if u 7^ 0. Therefore we have 



fi * /a 



P(Ext 1 (E 2 ,E 1 )) 
Eom(E 2l E 1 ) x G, 



Spec C 
Hom(£ 2 ,£i) x G^ 



+ 



C%(*4 



X; 



(86) 



Here the algebraic groups in the denominators act trivially on the varieties in the numer- 
ators. Since Ei G Ax are Z + -stable, we have 



Hom(£7i, E 2 ) 



A 1 , 
Spec C, 



if Pi = pi, 
if Pi 7^ Pi- 



Taking the integration of flES} over points on (Q^ 1 '" 1 ) x Q^'" 1 )) \ £> and D = Q^ m \ we 
obtain the decomposition (1791) . □ 



Lemma 5.4. T7ie element 5q G ?^(^4x) written as l[31\) such that x($o> 1) £ Z. 



f2 2771*) 

Proof. For a point p G ' > the object E p G satisfies Aut(E p ) = G m since .£/p is 
Z + -stable. Hence the diagonal subgroup G m C GL(2, C) acts on Q^' 2m ^ trivially, and the 
quotient group GL(2,C)/G m = PGL(2,C) acts freely on Q^' 2m \ Hence 5 is written as 
[[M/G m ] -»■ Obj(A x )} for an algebraic space M = Qf 2m) / PGL(2, C), and G m acts on 
M trivially. Since any algebraic space is written as a disjoint union of quasi-projective 
varieties, d~ is written as (I3T1) with each q G Z. Therefore x(^0j 1) G Z follows. □ 



35 



For 1 < i < 4, we set e» G 7i(^4x) as follows, 

ei — 6i- -5i. 

Lemma 5.5. T/ie element e\ G ?^(^4x) written as l[JJ\) such that x{ e ii 1) £ ^- 

Proof. For p G Qi' , it is easy to see that the object E p G Ax satisfies hut{E p ) = G m 
by using the exact sequence (1771) . Hence PGL(2, C) acts freely on Qf' 2 " 1 ^ as in the proof of 
Lemma 15.41 and the quotient space Qj 2 ' 2m) /PGL(2,C) is an algebraic space over C. Also 
it is easy to see that the objects Ei G Ax which appear in (PTTj) are uniquely determined 
up to isomorphisms for a given p G Q^ 2 ™^. Hence there is a map of algebraic spaces, 

7: Qi 2,2m) /PGL(2,C) _> (QC 1 ^) x g^ 1 '™)) \L>, 

such that if 7Q0) = (pi,P2), there is an exact sequence in Ax, 

0-^E Pl ^E p ^ E P2 — > 0. (87) 

By the construction, closed points of the fiber of 7 at (pi,^) bijectively correspond to 
isomorphism classes of objects E p G Ax which fit into an exact sequence (I8TI) . which also 
bijectively correspond to closed points in P(Ext 1 (i?p 2 , E P1 )). Therefore we have 

X (e u 1) = / x^Ext 1 ^, E Pl )))d X 

^(pi,P2)e(Q (1 ' m) xQ( 1 . m ))\D 

-\\ X {m^\E P2 ,E Pl )))d X) 

Z ^(pi,p 2 )e(Q( 1 ' m )xQ( 1 >™))\D 

= 0/ dimExt^Ep^EpJdx 

2 ~'(pi,P2)e(Q( 1 ^)xQ( 1 >'"))\D 

= / dimExt l (E p2 ,E Pl )dxeZ. (88) 



'(Pi,P2)eSym 2 (Q( 1 '™))\D 

In ( IHHj) . we have used the fact that 

dim Ext 1 (£ P2 ,E P1 ) = dim Ext 1 (£ Pl , £. 
for (pi,P2) G (Q ( ' 1 ' m ' ) x Q( l ' m >) \ D, which follows from the formula (|4Ti) and 

Hom(E Pl , E P2 ) = Rom(E P2 , E Pl ) = 0. 



J P2)1 



□ 



Lemma 5.6. The element €2 G 7i(Ax) is written as l[JJ\) such that xi e 2, 1) = 0. 

Proof. Let T G = C GL(2,C) be the subgroup of diagonal matrices, and consider 
the associated G^-action on Q^' 2m \ Since the subgroup G m C T° given by (I2"7j) acts on 
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Q(2,2m) trivially, q UO tient group T G / 
points is the image of the map 



G m acts on Q^' 2m ^ . The set of T G / G m -fixed 



l: (Q (1 ' m) x Q^)\D^ Q 



(2,2m) 
2 ) 



defined by 



((O x ^F 1 ),(O x ^F 2 



(O 



(si,sa) 



It is easy to see that i is an injection, and T G /G m acts on Q 2 2 ' 2m ^ \ Imt freely. We set 



Q(2,2m) ^ q ^ e ^ e q U0 ^i en t algebraic space, 



Q 2 2 ' 2m) 

Noting (1751) . we obtain that 

Obj(A x ) 



(Q( 2 ' 2m) \ImO/(T^/G m ). 



G , 



1 




Im i 




2 




G 2 

. m _ 




3 




~ Q {2 ' 2m) ~ 


4 




G ?r 




1 




"g(2,2m)" 


2 




G m 



1 

+ 2 



(2,2m) 
2 



G. 



1 

2 

3 
4 



(0 



(l,m) 



g^ 1 '™)) \ d 



G 2 



Obj(A 



x 



Q 



(2,2m) 
_2 

G m 



0&j(.A. 



x, 



39) 



Hence e 2 is written as fl3Tj) . Let us compute the Euler characteristic of Q^' 2m \ For a 



point p G ,2m) and the object E p G A x , take (pi,p 2 ) G (Q (1 ' m) x Q^™)) \ D such that 
£p = E P1 © £7 P2 . It is easy to see that the pair (Ei, E 2 ) is uniquely determined up to 
isomorphisms and a permutation. Hence p i— *> (pi,P2) defines a well-defined map, 



1--Q 



(2,2m) 



Sym 2 (Q( 1 ' m )) \D. 



For (pi,p 2 ) G Sym 2 (Q( 1 '" 1 )) \ D, the GL(2, C)-action on Q {2 ' 2m) induces a map, 

GL(2,C)^7 _1 (Pi,P2), 

which is a G^-bundle over 7 _1 (pi,P2)- Restricting to 7 _1 (pi,P2) \ Imt, we obtain the 
G^-bundle over 7~ 1 (pi,P2) \ Imt, 



GL(2, C) \ (T G U i{T G )) -» 1 - 1 (p 1 ,p 2 ) \ Imt. 



Here i 



1 

1 



G GL(2,C). Since G^ is a special algebraic group, the above map is 
Zariski locally trivial. Hence the virtual Poincare polynomial of 7 _1 (pi,P2) \ Imt is 

P,(GL(2,C)\(T G U*(T G ))) 



Pt{l l (pi,P2) \Imt) 



t 4 + t 2 -l. 



(90) 
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The free T G /G m = G m -action on Q( 2 ' 2m )\Im i restricts to the free G m -action on 7 1 (pi,p2)\ 
Iuu. By fl90|) . we have 

t 4 + t 2 - 1 



^((7 _1 (Pi,P2)\Init)/G m ) 



t 2 - 1 



t 2 + 2. 



By inverting t — 1, we obtain 

x((7 _1 (Pi)P2) \Imt)/G m ) = 3. 
Now the map 7 descends to a map 

7 / :Q?' 2m) -Sym 2 (g^))\A 
such that the Euler characteristic of each fiber of 7' is 3 by f[9~Tj) . Therefore we obtain 



(91) 



3- x (Sym 2 (Q {1 > m) )\D) 
l(x(Q (1 ' m) ) 2 -x(Q {1 ' m) ))- 



(92) 



On the other hand, since the T G /G m -fixed points in Q^' 2m ^ coincides with Imt, the 
localization implies 



x(Q?' 2m) ) = x(Q {1 ' m) ) 2 -x(Q { 

By (J89D, Q22D and ([93]), we obtain x(e 2 , 1) = 0. 
Lemma 5.7. JTie element G 7i(^4x) written as l[3l\) such that 

x(e 3 ,l) = j X (Q (1 ' m) ), (modZ). 

Proof. For a point p G Q3 , the object G Ax satisfies 

Aut(£) = Stab p (GL(2,C)) = A 1 x G m , 

since _E P fits into the exact sequence (177|) with E± = E2. Then for the diagonal matrices 
T G C GL(2,C), we have Stab p (GL(2, C)) n T G is the subgroup G m C T G given by (j27jl . 
Therefore the action of T° on Qf' 2m ^ descends to the free action of T° /G m = G m . We 
set Qf' 2m ' 1 to be the quotient algebraic space, 

^2,2m) = g ( 2 , 2m ) /(T G /Gm)> 



)(l,m) 1 



(93) 
□ 

(94) 



Using (T78l) and the relation (|28|) . we have 



£3 = 



(2,2m) 
3 



Ob j {A 



x. 



3 
4 



g(2,2m) 



1 

2 /. 



p e Q(i,m) 



■pfExt 1 ^,^)) 



(95) 
(96) 
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Here the algebraic groups in the denominators act on the varieties in the numerators 
trivially. Therefore e% is written as (l3"Tj) . Let us calculate the Euler characteristic of 
Qf' 2m \ For p G Qf' 2m \ let j(p) G Q^ 1,m ^ be the point such that E p fits into the exact 
sequence ( ITT)) with E\ = E^y It is easy to see that p h- > 7(p) is a well-defined morphism 
of varieties, 

For p' G Q^' m \ the fiber of 7 at p' carries a surjection, 

which sends a point p G 7~ 1 G» / ) to the extension class of (T77|) . For w G Ext^-Ey, _E p /)\{0}, 
we have the surjective morphism, 

7": GL(2,C)-W~V), 

induced by the GL(2, C)-action on Q( 2 ' 2m \ Each fiber of 7" is isomorphic to the special 
algebraic group A 1 x G m , hence 7" is Zariski locally trivial. The free T G /G m -action on 
Q<, 2 > 2m ) res t r j c t s to the free T G /G m = G m -action on / y'~ 1 (u), and the virtual Poincare 
polynomial of the quotient space is 

p( \/r \ ^(GL(2,C)) 
P t (7 (u)/G m ) 



P t (A! x G m )P t (TG/G m ) 
= t 2 + 1. (97) 

Now 7' descends to a morphism 

7- 1 ( J E)/G m -.P(Ext 1 (E, J E;)), 

such that the Euler characteristic of each fiber is equal to P t {^ (u) / 'G m )\t=i = 2 by ()9~Tj) . 
Therefore xW-j 2 ' 2 "^) is 

x(Q?' 2m) ) = 2 / dimExt 1 ^, E p ) d X . (98) 

Since G m acts on Qf' 2m ^ freely, we have xiQ^' 2 " 1 ^) — 0- By f|93|) and (|9"5|) . we have 

X (e 3 , 1) = \ f dimExt 1 (E P ,E P ) d X . (99) 
On the other hand, the same argument of [31 Theorem 4.11] shows that 

By (JHHD and ffTUD]) . we obtain flM}. □ 
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Lemma 5.8. The element G TC(Ax) is written as l[31\) and we have 



x(6 4 , i) = — A x{Q^ m) ) 



Proof. By ([78]) and noting that F(G, T G , T G ) = 1, F(G, T G , G r 
T G = {0} x G 2 m and G m C T G given by (J2ZJ), we have 



-1 for G = A 1 x G 2 m , 
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(l,m) 



G 2 







(l,m) 



G 2 

m J 



g(l,m) 



3 
4 
1 
2 



■g(i,m) 
G m 

g(l,m)" 



Here the algebraic groups in the denominators act on the varieties in the numerators 
trivially. The above formula immediately imply the result. □ 

Proof of Theorem 15. 2t 

Proof. By (I76p , Lemma I5.4[ Lemma 15.51 Lemma 15.61 Lemma 15.71 and Lemma 15. S\ we 
obtain 

Q{2,2m) = -^^ 42m-l + (-l) m } ( mod Z ) 

= ( mod Z ). 



□ 
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